SHM Converge Scientific Abstract ePoster Gallery-The Gem: "How To" Hospital Medicine and Early Experience Building an Ai Companion

Pdf Summary

The article describes the creation of the Guide to Essentials in Medicine (GEM), a living document designed to help hospitalists navigate highly local, practical aspects of hospital medicine such as policies, procedures, specialty services, and community resources. Because traditional medical education often does not cover these institution-specific details, the team built GEM as a crowdsourced, continually updated OneNote guide with more than 300 pages, developed by six hospitalist editors and informed by over 50 hospitalists plus input from specialists, care managers, nurses, and external community partners.<br /><br />The project also explored turning GEM into an AI companion using a custom large language model. Initial testing showed reliability problems, including hallucinated phone numbers, nonexistent services, incorrect precautions, and mistaken interpretation of official procedures. After refining prompts and restricting the model to directly cite only the GEM source document, accuracy improved substantially. In a sample of 30 questions, the average answer score increased from 6.2 to 7.5 out of 8.<br /><br />Implementation was associated with improved provider perception of available practical resources. Pre- and post-implementation surveys showed the likelihood to recommend current resources rose from a net promoter score of 5.9 to 7.6 overall. Among providers who had onboarded within the previous two years, scores also improved, though this change was not statistically significant. The post-survey mean usefulness rating of GEM was 7.7 out of 10.<br /><br />Overall, the authors conclude that hospitalists can collaboratively build a useful “hive mind” resource for daily logistics, and that an AI companion can work if tightly constrained to the source material.

Asset Subtitle

Sean Legler

Meta Tag

Author List Alex G. Theofiles, Chris A. Dinh, Eileen M. Russell, Ivana Ho, Paff Shenoy Chris, Ragaisis Taryn, Sean Legler, Tiffany J. Galush

Category Innovations

Concept GEM

Concept Institution-Specific Practice Logistics

Concept Hallucination

Concept Local Clinical Logistics

Concept Hospitalist Role

Distinguished Non-Finalist

Presenter Organization Mayo Clinic

Presenting Author Sean Legler

Track Technology in Hospital Medicine

Keywords

hospital medicine

Guide to Essentials in Medicine

GEM

hospitalist resource

living document

OneNote guide

crowdsourced knowledge

AI companion

large language model

provider perception

GEM

Institution-Specific Practice Logistics

Hallucination

Local Clinical Logistics

Hospitalist Role